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^.^ Symmetry reduction by the method of slices is applied to pipe flow in order to quo- 

''O tient the stream-wise translation and azimuthal rotation symmetries of turbulent flow 

i,L states. Within the symmetry-reduced state space, all travelling wave solutions reduce to 

i-H equilibria, and all relative periodic orbits reduce to periodic orbits. Projections of these 

solutions and their unstable manifolds from their oo-dimensional symmetry-reduced state 

fj space onto suitably chosen 2- or 3-dimensional subspaces reveal their interrelations and 

" ^ the role they play in organising turbulence in wall-bounded shear flows. Visualisations 

^^ of the flow within the slice and its linearisation at equilibria enable us to trace out the 

r^ unstable manifolds, determine close recurrences, identify connections between different 

Oh travelling wave solutions, and find, for the first time for pipe flows, relative periodic orbits 
that are embedded within the chaotic attractor, which capture turbulent dynamics at 

,-H transitional Reynolds numbers. 

> 

^^ 1. Introduction 

The understanding of chaotic dynamics in high-dimensional systems that has emerged 



in the last decade offers a promising dynamical framework to study turbulence. Here 
turbulence is viewed as a walk through a forest of exact solutions in the cx)-dimensional 



pg state-space of the governing equations. In pipe flow, the discovery of unstable travelling 

,-H waves (Faisst & Eckhardt 2003; Wedin & KcrswcU 2004), together with glimpses of 

ILJ them in experiments (Hof et al. 2004), has spurred interest in obtaining a description of 

• ^H turbulent flow in terms of the dynamics of a handful of key exact solutions. However, 

^ evidence of the relevance of the dynamical system approach to turbulence has so far been 

mostly provided by studies of plane Couette flow (Gibson tt al. 2008, 2009; Halcrow et al. 

2009), with the discovery of periodic (Kawaliara & Kida 2005; Cvitanovic & Gibson 

2010) and relative periodic orbits (Viswanath 2007) embedded in turbulence playing 

the key role. In this approach, the dynamics of turbulent flows at moderate Reynolds 

number (Re) is visualised using equilibrium solutions of the Navier-Stokes equations to 

define dynamically invariant, intrinsic, and representation-independent coordinate frames 

(GibstHi et al 2008). The resulting visualisations show the role exact solutions play in 

shaping turbulence: the observed coherent structures are the physical images of the flow's 

least unstable invariant solutions, with turbulent dynamics arising from a sequence of 

transitions between these states. Here the intrinsic low-dimensionality of turbulence stems 

from the low number of unstable eigendirections for each state. In this picture periodic 
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Figure 1. Symmetry reduction replaces each full state space trajectory a{t) by a simpler 
reduced state space trajectory a{t), with continuous group induced drifts quotiented out. Here 
this is illustrated by the relative periodic orbit RPO36.72 (see figure 9 6) (a) traced in the full 
state space for three T — 36.72 periods, in the frame moving with the constant axial phase 
velocity c = 1.274, the average phase velocity of structures estimated from a long simulation; 
dots are spaced T apart in time; (b) restricted to the symmetry-reduced state space. Both are 
projected onto the 3-dimensional frame (2.16). In the full state space a relative periodic orbit 
traces out quasi-periodically a highly contorted 2-torus; in the reduced state space it closes a 
periodic orbit in one period T. 



orbits are of particular importance, as they provide the skeleton underpinning the chaotic 
dynamics (Cvitanovic et al. 2011). In shear flows evidence is emerging that the geometry 
of the state space near the onset of turbulence is governed by a chaotic saddle, a set 
of unstable solutions and their heteroclinic connections (MuUin cV: iverswell 20()-''>). The 
long-term goals of this research program are to develop this vision into a quantitative, 
predictive description of moderate- i?e turbulence, and to use this description to control 
flows and explain their statistics. 

In contrast to plane Couette flow, pipe flow has a non-zero mean axial velocity and can- 
not sustain equilibria and periodic orbits with both broken translational symmetry and 
zero phase velocity. Hence in pipes, unstable invariant solutions are generically stream- 
wise travelling solutions. The dynamical importance of invariant solutions is specified 
by periodic orbit theory, in which the contribution of each solution to any dynamical 
average over the chaotic component of the flow is quantified by a deterministic weight 
(Cvitanovic et al. 2011). In the presence of continuous symmetries periodic orbit theory 
extends to weighted sums over relative periodic orbits (Cvitanovic 2007). While a large 
number of unstable travelling waves have been identified in pipe fiow (Faisst & Eckhardt 
2003; Wcdin & Kcrswcll 2004; Pringle fc Kerswcll 2007; Pringic et al. 2009), their neigh- 
bourhoods are visited for only 10-20% of the time (Kerswcll & Tutty 2007; Schneider 
et al. 2007; Willis & Kcrswcll 2008), and so it is expected that relative periodic orbits 
capture most of the natural measure of the turbulent flow. Although a few unstable 
'tiny' relative periodic orbits have already been found (Duguct et al. 2008; Mcllibovsky 
& Eckhardt 2011/;), these stem from bifurcations of nearby travelling waves and exhibit 
only minute deviations about them. More recently, Mcllibovsky & Eckhardt (201 lo) have 
identified a new relative periodic orbit appearing at a global Shilnikov-type bifurcation. 
All these solutions, however, lie far from turbulent dynamics and hence do not provide 
information about the structure of the chaotic saddle underlying turbulent flow. 

One of the main difficulties in identifying relative periodic orbits embedded in turbu- 
lence is that each of them travels downstream with its own mean phase velocity. Therefore 
there is no single co-moving frame that can simultaneously reduce all relative periodic 
orbits to periodic orbits and all travelling waves to equilibria. This problem is here ad- 
dressed by the method of slices (Rowley & Marsdcn 2000; Bcyn & Thiinunlcr 2004; 
Siminos & Cvitanovic 2011; Froehlich & Cvitanovic 2011), in which the group orbit of 
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any full- flow structure is represented by a single point, the group orbit's intersection with 
a fixed co-dimension one hypersurface or 'slice '. Although this is analogous to the way 
a Poincare section reduces a continuous time orbit to a sequence of points, it should be 
stressed that a slice is not a Poincare section. A slice fixes only the group parameters: a 
continuous time full space orbit remains a continuous time orbit in the symmetry-reduced 
state space (see figure f). 

Our goals are two-fold. First, we explain what symmetry reduction is and how it can 
aid in revealing the geometry of the state space of pipe flow. Second, we demonstrate 
that this new tool enables us to commence a systematic exploration of the hierarchy 
of dynamically important invariant solutions of pipe flow. Symmetry reduction is here 
combined with 3D spatial visualisation of instantaneous velocity fields to elucidate the 
physical processes underlying the formation of unstable coherent structures. Running 
concurrently, the oo-dimensional state-space representation (Uibson at at. '2UU8), enables 
us to track the unstable manifolds of invariant solutions, the heteroclinic connections 
between them (Halcrow et al. 2009), and provides us with new insights into the nonlinear 
state space geometry and dynamics of moderate Re wall-bounded flows. Starting in 
neighbourhoods of the known travelling waves (Pringle et al. 2009) as initial conditions 
and then searching for close recurrences (Auerbach et al. 1987; Cvitanovic & Gibson 
2010) in the reduced state space yields educated guesses for locations of relative periodic 
orbits. Applying Newton-Krylov methods to these initial guesses leads to the discovery 
reported here, the first examples of relative periodic orbits embedded into pipe turbulence 
(see figure 9 b) . 

The paper is organised as follows. We review pipe flows, their visualisation, and their 
symmetries in §2. The method of slices is described in §3, and the computation of 
invariant solutions and their stability eigenvalues and eigenvectors in §4 and §5.1. The 
main advances reported in this paper are the symmetry-reduced state space visualisation 
of moderate- iZe turbulent pipe flow, revealing the unstable manifolds of travelling waves, 
and the determination of new relative periodic orbits (§ 5.2). Outstanding challenges are 
discussed in § 6. Appendix A contains a classification of invariant solutions according to 
their symmetries. 



2. Pipe flows 

The flow to be considered is that of an incompressible viscous fluid confined within 
a pipe of circular cross-section, driven by a constant mass-flux in the axial direction. 
The Reynolds number is defined as Re = UD/v, where U is the mean velocity of the 
flow, D is the pipe diameter, and ly is the kinematic viscosity. We scale lengths by D 
and velocities by U in the Navier-Stokes equations for u, the deviation from the laminar 
Hagen-Poiseuille flow equilibrium U{r) = 2 (1 — 2r^) z, 

du B 1 

-— + U -Vu + u-VU + u-Vu = -Vp + i2—z.+ —V'^u, V-m = 0. (2.1) 
at Re Re 

Hereafter all times will be expressed in dimensionless units D/U . Note that the dimen- 
sionless variable /? = /3(i) is the fractional pressure gradient needed to maintain a constant 
mass-flux, additional to that required to drive the laminar flow. A Reynolds number Rcp, 
based on the applied pressure gradient, is given by Rcp = Re{l -\- P), whereas the fric- 
tion Reynolds number is Rcr — ^j2Rep. The Navier-Stokes equations are formulated 
in cylindrical-polar coordinates, where (r, 0, z) are the radius, azimuthal angle and the 
stream-wise (axial) positions, respectively. The full fluid velocity field U(r) -I- u is rep- 
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resented by [u,v,w,p\{r,9, z), with u, v and w respectively the radial, azimuthal and 
stream-wise velocity components, and p the pressure. 

In numerical simulations no-slip boundary conditions are imposed at the walls and the 
infinite pipe is represented by periodic boundary conditions in the stream-wise z direction. 
Hence the deviation velocity field u and the deviation pressure in the Navier-Stokes 
equations (2.1) are expanded in Fourier modes in the axial and azimuthal directions, 

uir^,e,z)= J2 E «nfc,„' e'(2"fc-+™™'«) , (2.2) 

\k\<K\m'\<M 

whereas the finite-difference method is used in the radial direction. The computational 
cell is 

n = [1/2, 2n/m, n/a] = {(r, 6, z) e [0, 1/2] x [0, 2n/m] x [0, n/a]} , (2.3) 

where L = ix j a is the length of the pipe. While m — 1 corresponds to the naturally 
periodic azimuthal boundary condition, e.g. m = 2 requires that the velocity field repeats 
itself twice in 6. This study is conducted at 

i?e = 2400, m = 2, a = 1.25 

n = [1/2, 7T,7t/ 1.25] w [90,283,452] wall units, (2.4) 

corresponding to a short L ~ 2.5£'-periodic pipe in the stream-wise direction. AIcl- 
libovsky & Eckhardt (2011fo,o) have also focused on m = 2 and studied cells with 
a G [1.1,1.85]. Furthermore, in this paper we restrict the dynamics to the 'shift-and- 
reflect' (2.11) invariant subspace: all invariant solutions and turbulence simulations pre- 
sented here are restricted to this subspace. 

In this computational cell at Re — 2400 the additional pressure fraction required 
to support turbulence while keeping constant mass-flux is /3 = 0.70, yielding friction 
Reynolds number i?e^ = 90.3. Here one pipe radius D/2 corresponds to about 90 wall 
units. At this Reynolds number and geometry turbulence is found to be transient, with 
characteristic lifetimes of order t w 10'^ D/U before the flow flnally relaminarises. It 
is worth noting that in long pipes without symmetry restrictions such a characteristic 
hfctime is found at Re — 1880 (Hof et al. 2008; Avila et al. 2010), where the flow takes 
the form of stream-wise localised puffs. 

The domain size (2.4) was chosen as a compromise between the computational prefer- 
ence for small domains vs. the need for the pipe to be sufficiently long to accommodate 
turbulent dynamics. In addition, restricting the largest wavelength is very useful in iden- 
tifying key coherent structures characterising turbulent dynamics (Hamilton et al. 1995). 
Although the pipes studied in this paper are short, the three-dimensional states explored 
here by equilibria and their unstable manifolds are strikingly similar to typical states in 
longer pipes. 

2.1. State-space visualization of fluid flows 

As long as one is focusing on a single solution of the Navier-Stokes equations, there are 
many excellent, physically insightful 3D visualisations of the flow: velocity fields on flow 
sections, isovorticity surfaces, videos of the flow, and so on. But today dozens of exact 
equilibrium and travelling wave solutions are known for a given turbulent flow, and 
the number is steadily growing. Furthermore, we are now commencing an exploration 
of states of turbulent fluids in terms of unstable periodic orbit solutions, whose number 
grows exponentially as a function of increasing period. How are we to visualise the totality 
of these solutions in one go? 

The answer was given by Hopf (1948). He envisioned the function space of Navier- 
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Stokes velocity fields as an infinite-dimensional state space M in which each instanta- 
neous state of 3D fluid velocity field m(x) is represented as a unique point a. In our 
particular application we can represent a — {u„km) as a vector whose elements are the 
primitive discretization variables (2.2). The 31? velocity field given by Uknm{t)^ obtained 
from integration of the Navier-Stokes equations in time, can hence be seen as trajec- 
tory a{t) in w 100, 000 dimensional space spanned by the free variables of our numerical 
discretisation, with the Navier-Stokes equations (2.1) rewritten as 

d = v{a), a{t) ^ a{0) + dt' v{ait')) . (2.5) 



la — a'll = (a — a 



JO 

Here the current state of the fluid a{t) is the time-i forward map of the initial fluid 
state a(0). In order to quantify whether two fluid states are close to or far from each 
other, one needs a notion of distance between two points in state space, measured here 
as 

i\a -a) = ^ dx{u- u') ■ {u - u') . (2.6) 

There is no compelling reason to use this 'energy norm', other than that velocity flelds 
is what is generated in a numerical computation. What norm one actually uses depends 
very much on the application. For example, in the study of 'optimal perturbations' that 
move a laminar solution to a turbulent one, both energy (Tcmpelmaim et ol. 2010) and 
dissipation (Lombardi et al. 2011) norms have been used. In our quest for travelling waves 
and relative periodic orbits (see § 5.2) we find it advantageous to use a 'compensatory' 
norm (4.3) that enhances the weight of cross-stream velocities. 

Visualisations of the state-space trajectory (2.5) are by necessity projections onto 
two or three dimensions. Flow states can be characterised by the instantaneous ki- 
netic energy of their velocity field, E = i||C7 + m|P, and energy dissipation rate D = 
i?e~^|| V X {U + u)\\^. The dissipation rate is balanced by the energy fed into the flow 
as 

E = I-D, (2.7) 

where / = y § dS [n ■ {u + U)] p is the external power required to maintain constant 
mass- flux. A physically appealing choice is to monitor the flow in terms of these symmetry- 
invariant, physical observables (-E(i)/-Eiamj -D(i)/£'ia„i, /(i)//iam), as in flgure 11. Note 
that /(t)//iam = 1 + /3(i). For travelling waves the kinetic energy is constant, so that 
D = I. Such solutions sit on the diagonal in figure 11 (a), whereas for relative periodic 
orbits the kinetic energy is time-periodic, with D = I only for long-time averages. Whilst 
this is a good check on correctness of numerical data, such projections bunch all invariant 
solutions and turbulent flow along the energy-balance lines, even though the solutions 
themselves can be (and often are) very distant from each other. In fact, if two fluid states 
are clearly separated in such plot, they are also separated in the high-dimensional state 
space. However, the converse is not true; states of very different topology might have 
comparable energies, and such plots may obscure some of the most relevant features of 
the flow. Furthermore, relations such as (2.7) depend on detailed type and geometry 
of a given problem (Greene & Kim 1988; Cvitanovic et al. 2009), and further physical 
observables beyond {E{t),D{t),I{t)) are difficult to construct. 

Recently, Gil)S(jn et al. (2008) have shown that with the state space considered as 
a high-dimensional vector space, the dynamics can be elucidated more profitably by 
computationally straightforward sets of physical coordinates. First, one identifies sev- 
eral prominent flow states ua, ub, ■ ■ ■ , such as equilibria and their linearised stability 
eigenvectors, in whose neighbourhoods the turbulent flow spends most of the time. From 
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them an orthonormal basis set {ei, 62, • • • , e„} is constructed by Gram-Schmidt and/or 
(anti)-symmetrizations. The evolving fluid state u{t) is then projected onto this basis 
using the inner product (2.6), 

a(t) = (ai, 02,- •• ,««,■••)(*)> an{t) = {u{t)\en) . (2.8) 

FinaUy, low-dimensional projections of the flow can be viewed in any of the 2D planes 
{amjO'n) or in 3D perspective views {a£,am,a„). An example is the figure 1 projection 
on the 3-dimensional frame {61,62,63} defined in (2.16). 

It is worth emphasising that this method offers a low-dimensional visualisation without 
dimension reduction or low-dimensional modelling; the dynamics are computed with fully- 
resolved direct numerical simulations. Although the use of particular travelling waves to 
define low-dimensional projections (see §5.1) may appear arbitrary, the choice turns out 
to be very useful when the turbulent flow is chaperoned by a few invariant solutions 
and their unstable manifolds, as for example in low Reynolds number plane Couette flow 
(Gibson et al. 2008). Such visualisations are essential to uncovering the interrelations 
between invariant solutions, and constructing symbolic dynamics partitions of state space 
needed for a systematic exploration of turbulent dynamics. This is the key challenge we 
address here for the case of turbulent pipe flows. 

2.2. Symmetries of pipe flow 

In many physical applications equations such as those of Navier-Stokes retain their form 
under symmetry transformations. Consider the Navier-Stokes equations in the state 
space formulation (2.5). A flow a = v{a) is said to be G-equivariant if the form of 
evolution equations is left invariant by the set of transformations g that form the group 
of symmetries of the dynamics G, 

v{a) ^ g-'^ v{g a) , for all 5 £ G . (2.9) 

On an infinite domain and in the absence of boundary conditions, the Navier-Stokes 
equations are equivariant under translations, rotations, and x — > — x, u — )• — u inversion 
through the origin (Frisch 1996). In pipe flow the cylindrical wall restricts the rotation 
symmetry to rotation about the z-axis, and translations along it. Let g{(f),t) be the shift 
operator such that g((/), 0) denotes an azimuthal rotation by (/) about the pipe axis, and 
g(0,€) denotes the stream-wise translation by t, let a denote reflection about the = Q 
azimuthal angle: 

g{(j)J) [u,v,w,p]{r,e,z) = [u,v,w,p\{r,e - (f),z - C) 

cr [u, w, w,p](r, 0, z) — [u,—v,w,p\{r,--0,z) . (2-10) 

The Navier-Stokes equations for pipe flow are equivariant under these transformations. 
The symmetry group of stream-wise periodic pipe flow is thus G — 0(2)e x 80(2)^ = 
Di K S0(2)g X 80(2)2, where Di = {e, cr} denotes azimuthal reflection, x stands for 
a semi-direct product (in general, reflections and rotations do not commute), and the 
subscripts z, 9 indicate stream-wise translation and azimuthal rotation respectively. For 
an assessment of the discrete symmetries in pipe flow see appendix A. 

Whilst the flow equations are invariant under G, the state of flow typically is not. Only 
the laminar Hagen-Poiseuille equilibrium is invariant under all of G, whereas a generic 
turbulent state has only the trivial symmetry group {e}. In this paper we restrict our 
investigations to dynamics restricted to the 'shift-and-reflect' symmetry subspace (A3), 

S^{e,cjg,}, (2.11) 

i.e. velocity fields (2.10) that satisfy [u,v,w,p\{r,9,z) — [u,~v,w,p\{r,—9,z — L/2) . In 
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addition, in some of the simulations (e.g. figure 8) we furtlier impose tlie 'rotate-and- 
reflect' symmetry 

Z2 ^{e,agg}, (2.f2) 

which is possessed by the highly symmetric waves found by Pringle et at (2009). In this 
case the velocity field also satisfies [u,v,w,p]{r, 0, z) — [u, — ?;, w,p](r, 7r/2 — 9,z) . 

It is worth emphasising that by imposing the symmetry S, rotations are prohibited 
and hence we consider only the simplest example of a continuous group, the stream-wise 
one-parameter rotation group S0(2)z, omitting the subscript z whenever that leads to 
no confusion. In the literature (see, e.g. Rcckc et al. (2011)) such S0(2) is often referred 
to as the circle group S^. 

2.3. Symmetry-induced coordinate frames 

So far we have not offered any advice as to the choice of basis vectors in constructing 
state space coordinates (2.8). In this section we show that the presence of a continu- 
ous symmetry suggests two natural mutually orthogonal basis vectors, the group action 
tangent and curvature vectors, suitable to local visualisations of group orbits. 

Consider the one-parameter rotation group SO (2) acting on a smooth periodic function 
u{9 + 27r) = u{9) defined on the domain 9 E [0, 2tt), expanded in the Fourier basis 



u{9) = y^ame 



imO 



Here u is real, so am = o,-m- Let us parametrise forward translations by the continuous 
parameter ^, g{(l))u{9) = u{9 — </>) , or, in Fourier space, g{(l)) a = diag{e~'™'^}a . The 
tangent to the group orbit at point a is then given by the first derivative with respect to 
the group parameter, and the direction of curvature by the second derivative, 

t(a) — lim ((7((/)) a — a) /(/) = diag{— Ittt,} a = Ta, (2-13) 

K(a)n(a) = T^a = -diag{m^} a, (2.14) 

where n is a unit vector normal to the tangent and 1/k is the radius of curvature. The 
pair of unit vectors 

{e„,e„+i} = {t(a)/|jt(a)||,n(a)} (2.15) 

forms a local orthogonal Frenet-Serret frame at state space point a, and can be useful in 
constructing the state space basis vector set (2.8). For example, in figure 1 the relative 
periodic orbit RPO36.72 is projected onto the 3-dimensional orthogonal frame 

{81,82,63} = {t(a')/l|t(a')ll, n(a'), (od - a')±/l|ad - a'lk} (2.16) 

where a' — a(0) is a point on the relative periodic orbit (such fluid snapshot is called 
'template' or 'reference state' in what follows), Od is the most distant point from d along 
its symmetry-reduced state space periodic orbit a{t), measured in the energy norm (2.6), 
and (Sd — a')j^ is the component of their separation vector, Gram-Schmidt orthogonalised 

to {81,62}. 

In what follows we consider time-dependent group parameters (/'(i), and the associated 
phase velocity cj) along the group tangent evaluated at the state space point a is given by 

g-'ga^e-^-^ (^ e^^^ a = • t(a) . (2.17) 

This formula for the phase velocity is known as the 'Cartan derivative'; for A^-parameter 
continuous symmetry the dot product is A^-dimensional, as in (2.18). 
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2.4. Relative invariant solutions 

In systems with continuous symmetries there are important classes of invariant solutions 
referred to as 'relative' or 'equivariant' (Huygcns 167.3; Poincarc 1896). In pipe flows one 
expects to find travelling waves and relative periodic orbits (Rand 1982) associated with 
the translational and rotational symmetries of the flow. Although these unstable flow- 
invariant solutions can only be computed numerically, they are 'exact' in the sense that 
they converge to solutions of the Navier-Stokes equations as the numerical resolution 
increases. 

A relative equilibrium (labelled here TW for travelling wave) is a dynamical orbit 
whose velocity field (2.5) lies within the group tangent space 

w(a)=c-t(a), (2.18) 

with a constant phase velocity {(pi,- ■ ■ , 4>n) = (ci, ■ • • , cn) and 4> defined in (2.17). Here 
A^ is the dimension of the continuous symmetry. In pipe flow N — 2 and {0„} = {</>, ^}, 
corresponding to rotations and translations. For a travelling wave, time evolution is 
confined to the group orbit 

a{t) = g{ct) a{0) , a{t) G Mtw ■ (2.19) 

As a travelling wave explores only its group orbit, a travelling wave is not a periodic 
orbit. Rather, as all states in a group orbit are physically the same state, this is a 
generalised equilibrium. In pipe flow relative equilibria can propagate in the stream- 
wise direction z (travelling waves), in azimuthal 6 direction (rotating waves), or both. 
However, in the shift-and-reflect subspace (2.11) considered here, rotations are precluded. 
In this case only stream- wise travelling waves are permitted, satisfying (2.19) 

/(m(0), t) = 5(0, -ct) u{t) - m(0) = , (2.20) 

where c is the stream-wise phase velocity. 

A relative periodic orbit p is an orbit in state space A4 which exactly recurs 

a{t) = 5p a{t + Tp) , a{t) e Mp 

after a fixed relative period T, but shifted by a fixed group action g that maps the 
endpoint a{T) back into the initial point cycle point a(0). In pipe flow, a relative periodic 
orbit p is a time-dependent velocity field 

Up(r, 0, z, t) = Up(r, + (l)p,z + ep,t + Tp) (2.21) 

that recurs after time Tp, rotated and shifted by (f)p and £p. In our Newton search for a 
relative periodic orbit p, we seek the zeros of 

fiuiO),T,£) = .g(0, -^) m(T) - «(0) = 0, (2.22) 

starting with a guess for the initial state of fluid u, period T, and shift i. 

Continuous symmetry parameters ('phases' or 'shifts') {'/'n} = {(f'pT^p} ^-re real num- 
bers, so ratios 7r/0„ are almost never rational, and relative periodic orbits are almost 
never periodic. In pipe flow the time evolution of a relative periodic orbit sweeps out 
quasi-periodically the 3-dimensional group orbit A4p without ever closing into a periodic 
orbit. 



3. Reduction of continuous symmetry 

We have seen that in presence of the continuous S0(2) symmetry, travelling waves and 
relative periodic orbits are 2- and 3-dimcnsional manifolds of physically equivalent states 
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M a(0) 

M ' 
(a) ^/ (b) 

Figure 2. (a) The group orbit A4a{o) of state space point a(0), and the group orbit Ma{t) 
reached by the trajectory a(t) time t later, (b) Symmetry reduction M ^ M replaces each full 
state space group orbit A^a C A^ by a single point in the reduced state space a £ M. 

generated by axial and azimuthal shifts. How are we to compare a pair of such states? 
We start by determining the minimal distance between them. 

The group orbit A^q of a state space point a S A^ is traced out by the set of all group 
actions 

Ma = {ga\geG}. (3.1) 

Any state in the group orbit set Ma is physically equivalent to any other. The action of 
a symmetry group thus foliates the state space into a union of group orbits, figure 2 (a). 

For the example at hand, a pipe flow (or a plane Couette flow) with two periodic 
boundary conditions, the symmetry group F contains two commuting S0(2) rotations. 
Each SO (2) subgroup group orbit is (topologically) a circle, see figure 3, and together 
they sweep out a T^ torus, see figure 4. 

The goal of symmetry reduction is to replace each group orbit by a unique point in 
a lower-dimensional symmetry-reduced state space Ai = M/G, as sketched in figure 2. 
Several symmetry reduction schemes are reviewed in Siminos & Cvitanovic (2011). Here 
we shall describe the method of slices (Rowley & Marsdcn 2000; Bcyn & Thiimmler 2004; 
Froohlich & Cvitanovic 2011), the only method that we find practical for a symmetry 
reduction of turbulent solutions of highly nonlinear flows, see § 5.2. 

In the method of slices the symmetry reduction is achieved by cutting the group orbits 
with a finite set of hyperplanes, one for each continuous group parameter, with each 
group orbit of symmetry-equivalent points represented by a single point, its intersection 
with the slice. The procedure is akin to (but distinct from) cutting across continuous- 
time parametrised trajectories by means of Poincare sections. As is the case for Poincare 
sections, choosing a 'good' slice is a dark art. Our guiding principle is to chose a slice such 
that the distance between a 'template' state a' and nearby group orbits is minimised, 
i.e., identify the point a on the group orbit (3.1) of a nearby state a which is the closest 
match to the template point a' . 

3.1. Method of slices; local charts 

After some experimentation and observations of turbulence in a given flow, one can 
identify a set of dynamically important unstable recurrent coherent structures. For ex- 
ample, coherent streaky structures have been observed in pipe flow at transitional Re 
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Figure 3. Projections of group orbits of two states a (in ~ 100, OOO-dimensional 
state space) onto stationary Frenet-Serret frames given by unit vectors in the directions 
{t2{a'),te{a'),n2{a')}, see (2.15). The state in (a) is a very smooth state, the 'lower-branch' 
travelhng wave LB, whereas in (b) it is a snapshot from a turbulent run. The group orbits are 
generated by all possible axial shifts g{0,£)a, and plotted relative to a template point a'. In 
(a) the state a = a — aLB(O) belongs to the "lower-branch" travelling wave Mlb described 
in §5.1; in (b) a is a 'typical' turbulent state shapshot with its group orbit as seen from the 
template a' — sml. Group orbits are only topologically circles; for strongly nonlinear, turbulent 
states many Fourier modes are of comparable magnitude, with their sums resulting in highly 
convoluted group orbits such as (b). 




Figure 4. As figure 3, but with the full 2-dimensional S0(2)s x S0(2)z group orbits traced 
out by shifts in both z and 6. Loops in solid red correspond to shifts in z, dashed blue loops to 
shifts in 9. 



(Hof et al. 2004) through to very high Re (Kim & Adrian 1999) where 'very large scale 
motions' have length scales comparable to the pipe radius. Streaky structures are also 
observed in the buffer layer of turbulent flows with a characteristic span- wise wavelength 
of approximately 100 wall units (Kline et al. 1967). 

We shall refer to this catalogue of n representative snapshots or 'reference states', either 
precomputed or experimentally measured, as templates (Rowley ic Marsck^ii 2000), each 
an instantaneous state of the 31? fluid flow represented by a point a'^^\ j = 1, 2, • • • , n, 
in the state space M. of the system. Symmetries of the flow (i.e. the g £ G) are then 
used to shift and rotate the template a' until it overlies, as well as possible, the coherent 
structure of interest a, by minimising the distance 



9{^)a'\ 



(3.2) 



The entire group orbit of a is then replaced by the closest match to the template pattern, 
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Figure 5. The method of shces, a state space visuahsation: (a) Shce A4 D A4/G hes in the 
(d — A'^)-dimensional hyperplane (3.3) normal to t', where t'j span the A^-dimensional space 
tangent to the group orbit ga' (dotted hne) evaluated at the template point a'. The hyperplane 
intersects all full state space group orbits (green dashes). The full state space trajectory a{t) 
(blue) and the reduced state space trajectory a{t) (green) are equivalent up to a 'moving frame' 
rotation a{t) — g{t)a{t), where g{t) is a shorthand for g{(j){t)). (b) In the full state space M 
a relative periodic orbit a(0) -> a{t) -> a{T) returns to the group orbit of a(0) after time 
T and a rotation by g, a(0) = ga{T). For flows with continuous symmetry a generic relati- 
ve periodic orbit fills out quasi-periodically what is topologically a torus. In the slice M the 
symmetry-reduced orbit is periodic, a(0) = a{T). This is a highly idealised sketch: A group orbit 
is a A'^-dimensional manifold, and even for SO(2) it is usually only topologically a circle (see 
figure 3), and can intersect a hyperplane any number of times (see figure 6 a). 



given by a = g^^a, as shifting does not affect the norm, ||a— ga'|| — \\a~a'\\. The 
symmetry-reduced state space 7W (hereafter referred to as the 'slice'), of dimension (d— 1), 
consists of the set of closest matches a, one element for each full state space M group 
orbit; the hat on a indicates the unique point on the group orbit of a closest to the 
template a' . 

For the azimuthal S0(2)e rotations (and likewise for the periodic pipe 80(2)^ stream- 
wise translations), the minimal distance satisfies the extremum condition 



d 



5(0) a'l 
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0, 



given that group orbits are smooth differentiable manifolds. As ||(7((/))a'|| is a constant, the 
group tangent vector Tga' evaluated at a' (2.13) is normal to a', and the term (a'|Te a') 
vanishes (T^ is antisymmetric). Therefore the point a on the group orbit that lands in 
the slice, satisfies the slice condition 



(alt'; 



, tfl = Toa' , 



(3.3) 



The slice so defined is thus a hyperplane that includes the origin, normal to the template 
group tangent evaluated at the template. 

When a is varies in time, d — v{a), the template a' tracks the motion using the 
slice condition (3.3) to minimise \\a{t) — g{(j>{t))a'\\, and the full-space trajectory a{t) 
is thus rotated into the reduced state space, a{t) = g~^ a{t), by appropriate moving 
frame (Cartan 1935; Fcls & Olver 1998, 1999; Olvcr 1999) angles {(/)(*)„}, as depicted 
in figure 5 (a). Specializing to S0(2), one can vifrite the equations for the reduced state 
space flow, a{t) g M confined to the shce, a = v{a), as 



v{a) — v{d) — 0(a) t(d) 
^(a) = (z;(a)|t')/(t(a)|t'). 



(3.4) 
(3.5) 
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Figure 6. (a) Every slice hyperplane cuts every group orbit at least twice (see figure 5). An 
S0(2) relative periodic orbit is topologically a torus, so the two cuts are the two periodic orbit 
images of the same relative periodic orbit, the good close one, and the bad distant one, on 
the other side of slice border, and thus not in the slice. Here this is illustrated by close cut 
(blue, solid line) of the relative periodic orbit RPO36.72 torus, figure 1(6), plotted together 
with the most distant cut (red, dashed), in the same slice hyperplane, but not in the slice, (b) 
Comparison of symmetry-reduced trajectory using a single template ML (blue, short-dash) with 
the same trajectory symmetry reduced using the travelling waves in table 1 as template (red, 
sohd) indexed by j{t) (j = 1 laminar; 2 LB; 3 ML; 4 MU; 5 UB; 6 S2U; 7 S2L), with template at 
time t indicated on left ordinate by (green, long-dash) line. Right ordinate: the shift deviation 
from the mean shift, £{t) — ct, where c ~ 1.274 is estimated by a long-time simulation. Both 
symmetry reductions begin with the same template and experience the same jumps in the shift 
starting at t « 40. By starting to switch the templates at i ~ 60, further jumps (seen for the 
blue, short-dash line) are avoided (red, solid line). 



In other words, u, the velocity in the full state space, can be written as the sum of v, 
the velocity component in the slice, and (j)t, the Cartan derivative (2.17) or the velocity 
component along the group tangent directions. The (j) equation is the reconstruction 
equation: its integral keeps track of the group shifts in the full state space. In particular, 
if o is a point on a travelling wave (2.18), the full state space velocity equals the phase 
velocity, and v{d) = 0, i.e., travelling waves are always reduced to equilibria in the slice. 
It should be emphasised that we never integrate the reduced equations (3.4); numerical 
simulations are always carried out in the full state space. Slicing is implemented as 
postprocessing of numerical or experimental data, by rotating full state space trajectories 
into the slice, as in figure 5. 

3.2. Charting the reduced state space; a global atlas 

The method of slices as implemented here associates a slice (3.3) to a template. Our 
slice is locally a hyperplane, expected to be a good description of solutions similar to a 
given template only in its neighbourhood. Nevertheless, as every group orbit has a point 
closest to a given template, and a slice is the set of all such group-orbit points, it slices 
the group orbits of all full state space points. The variational distance condition (3.3) 
is an extremum condition, and as the group orbits of highly nonlinear states are highly 
contorted (see figure 46), the distance function can have many extrema, and multiple 
sections by a slice hyperplane. For example, a relative periodic orbit sweeps out a torus, 
and is always intersected by a slice hyperplane in two or more periodic orbit sections, 
once at the orbit's closest passage to the template, with positive curvature (2.14), and 
another time at the most distant passage, also satisfying the slice condition (4.2), but 
with negative curvature (see figure 6 a). 

As explained in Frochlich & Cvitanovic (2011), a slice hyperplane captures faithfully 
neighboring group orbits as long as it slices them well; it does so until it reaches the 



Revealing the state space of turbulent pipe flow 13 

chart border, the set of points a* sufhciently far from the template, whose group orbits 
are grazed tangentially rather than sliced transversely. For such grazing group orbit the 
group tangent vector lies in the slice, and is thus orthogonal to the slice tangent, 

(t(a*)|t')=0. (3.6) 

The phase velocity (j){a*) in (3.5) then diverges. While such divergence is an avoidable 
nuisance, an artifact of the symmetry reduction to a particular slice hyperplane, it is a 
numerical nuisance nevertheless. 

For points beyond the chart border (3.6) the group orbits have more than one inter- 
section with the slice. It is clear what the trouble with any single slice hyperplane is: the 
nonlinear flow of interest is taking place on a highly contorted curved manifold embedded 
in the oo-dimensional state space, so a single template cannot be a good match globally. 
It is as good as a projection of the whole Earth onto a single flat map centered on Ulan 
Bator. The physical task is to, in order to chart the state space of a turbulent flow, pick a 
set of qualitatively distinct templates a'^^^ whose slices Ai'^^^ span across neighbourhoods 
of the qualitatively most important coherent structures, and which together capture all 
of the asymptotic dynamics and provide a global atlas of the dimensionally reduced state 
space M = A4/G. The choice of templates should reflect the dynamically dominant pat- 
terns seen in the solutions of nonlinear PDEs, one typical of, let us say, 2-roll states, one 
for 4-roll states, and so on. Each slice hyperplane comes with its chart border hyperplane 
of points a* , defined by the grazing condition (3.6), beyond which it should not be de- 
ployed as a chart. Together they 'Voronoi' tessellate the curved manifold in which the 
symmetry-reduced strange attractor is embedded by a finite set of hyperplane tiles. 

For example, in reducing turbulent trajectories of § 5.2, we deploy a set of travelling 
waves as our templates. Each associated slice A^'--'', provides a local chart at a'^^^ for a 
neighbourhood of an important, qualitatively distinct class of solutions. In our simula- 
tions we keep checking the distance to the template of the symmetry-reduced trajectory, 
and switch to the next template neighbourhood before the trajectory encounters the 
chart border (3.6) of the current one, as illustrated by figure 6(6). 



4. How to slice a pipe 

Slicing is independent of numerical representation. We describe our implementation, 
however, using the convenient discretisation for pipe flow of (2.2). The deviation velocity 
field u and deviation pressure in the Navier-Stokes equations (2.1) are discretised as in 
(2.2), using Fourier modes in the axial and azimuthal directions and a finite-differences in 
the radial direction, with coefficients Unkm- The radial points, r„ for n = 1, 2, • • • , A^, are 
non-uniformly spaced, with higher resolution towards the wall. Flow variables being real 
implies that the coefficients satisfy u„km = «* _^ _^. Time-stepping has been performed 
using a second-order predictor-corrector method with a time-step of At = 0.0025. To 
ensure dealiasing in the evaluation of nonlinear terms, Fourier series are evaluated on 3K 
and 3M spatial points in z and 9 respectively. For the calculations presented, a resolution 
of {N, K, M) — (64, 16, 16) has been used, corresponding to 64 x 48 x 48 grid points. 

4.1. Rotation into the slice 

In this paper we consider only shifts £ in the stream- wise direction (2.10). Denoting our 
state by a = (unkm), the group tangent t(a) — T^ a to a in the direction of axial shifts 
is given by (2.13), 

t(M)nfem = ~2ak i Unkm , (4.1) 
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and the shift £{t) of state space trajectory a{t) into the sHce is determined by the shce 
condition (3.3), 

/Wi)) = (.9(0,-£(i))a(f)|t')=0, (4.2) 

where t' is the group orbit tangent evaluated at a template state a'. As long as the norm 
is discretisation independent, the slice condition (4.2) is independent of the numerical 
representation of the flow u, be it finite difference, spectral, and so on. The slice condition 
is solved for £{t) every few time steps using Newton's method, where a good initial guess 
for £{t) is obtained from the previous value and £{t). 

When a{t) is close to a' , the function f{i) has only one root. When a{t) is far from a' , 
however, /(£) may have many roots, pairs of which may disappear with time. This would 
lead to a discontinuity in i{t). As explained in § 3.2, in order to avoid this, a global atlas 
has to be pieced together from local slice charts, fixed by a well-chosen set of templates 
a''--'' . Shifts ij{t) are tracked for each local slice chart Ai'^^\ and the next slice hyperplane 
7V{(-'+^) with ij^i{t) is selected whenever the distance to the next template minimises 
||a(i)-a'(J+i)||. 

4.2. Dynamically important solutions and Newton's m,ethod 

For pipe flows many stream-wise travelling waves satisfying (2.20) are known, and can 
be used as the starting points for our relative periodic orbit searches. The most of known 
solutions have no azimuthal precession. This is usually imposed by symmetry, but one 
could argue that it is the strong stream- wise advection that favours structures with very 
weak azimuthal rotation speed, empirically \cg\ < O{10~^). Stream-wise travelling waves 
evolve in time along their group orbit, generated by g{0,£{t)). They therefore satisfy the 
slice condition (4.2) for £{t) = £o + Czt- 

The few pipe flow relative periodic orbits that have been found prior to this study were 
located via tracking a Hopf bifurcation off a travelling wave solution (Duguct et al. 2008; 
Mellibovsky t Eckliardt 20116). These 'modulated travelling waves,' here referred to as 
'tiny' travelling waves, stick close to their mother orbits, and explore little of the state 
space, with temporal dynamics barely distinguishable from parental travelling waves. In 
contrast, in our Newton searches for relative periodic orbits, we seek the zeros of relative 
periodic orbit condition (2.22) deep in the turbulent sea. The way in which the method 
of slices enables one to find initial guesses for (n(0), T, £), is the main difference between 
this study and the previous searches for relative periodic orbits in pipe flows. 

Here we take as initial guesses samples of nearly recurrent velocity fields generated by 
long-time simulations of turbulent dynamics (Aucrbach et al. 1987; Cvitanovic & Gibson 
2010). The intent is to find the dynamically most important solutions, by sampling the 
turbulent flow's natural measure. In practice, sufficiently good full state space initial 
guesses for (u(0), T, £) would be almost impossible to find. Checking correlations between 
u{t) and g(0,£)M(i — T) for each T, and more problematically, for all possible shifts 
{4>,£), is an unrealistic task. The method of slices, however, enables us to determine close 
recurrences from the symmetry-reduced time series, and locates the dynamically most 
important solutions, i.e., those trajectories that are most likely to be observed in a long- 
time turbulent simulation. The relative periodic orbits are reduced to periodic orbits, 
whose unstable manifolds are much easier to track in the reduced state space. The rela- 
tive periodic orbit shift £ is given by the reconstruction equation, (3.5), or, in practice, 
by phase shift £{T) — ^(0), where £{t) is quickly calculated by intermediate Newton steps. 

With a good initial guess for {u{0),T,£), such a system can be solved using a Newton 
scheme. Two conditions in addition to (2.22) need to be enforced: the Newton update 
should have no component along the group orbit, {du\t{u)) — 0, and no component 
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tangent to trajectory, {Su\u) = 0. To solve this system a 'hookstep' trust-region varia- 
tion to the Newton-Krylov method has been implemented, similar to that of \ iswanath 
(2007). This method greatly increases the tolerance in the starting (m(0),T, £) required 
for convergence to an exact solution. 

The radial and azimuthal components of the flow are typically smaller than the stream- 
wise component by a factor of approximately 3 to 10. The components u and v, however, 
can be associated with 'rolls' in the flow that are as important to the self-sustaining 
mechanism of turbulence as 'streaks', associated with deviations in the w component. 
This observation motivates use of an empirical 'compensatory norm', 

||m||^ = {u\u)^ = - {9u-u + 9vv + ww)dV , (4.3) 

2 Jv 

found to be useful for the calculation of recurrences and to assist convergence in our 
Newton scheme. 



5. The sliced pipe 

For our first exploration of the state space of pipe flow, we have chosen a cell size and 
Reynolds number combination (2.4) empirically balanced so that Re is just sufficient to 
sustain long periods of turbulence. Among the many travelling waves already known, we 
have chosen to focus on the family of solutions classed N2 in Pringlc et al. (2009). At the 
parameter values (2.4), the N2 family has the upper and lower branches (UB and LB), as 
well as two middle states (MU and ML), where 'upper' and 'lower' refers to the friction 
or dissipation (2.7), associated with each state. The middle states should not be confused 
with the M branch of solutions documented in Pringle et al. (2009), for which the M2 
branch does not appear to exhibit solutions at these particular parameters. States of the 
S class do exist at these parameter values, however. Figure 7 shows all travelling waves 
considered in this work. 

5.1. Sliced travelling waves 

For the sake of simplicity we consider first the dynamics restricted to the {S, Z-i) symme- 
try subspace of the N2 states. A convenient property of the ML state at our parameter 
values (2.4) is that it has only one complex unstable eigenvalue within this symmetry 
subspace. The trajectories of small perturbations therefore spiral away from ML as they 
follow its unstable manifold. With ML drifting in the axial direction, this local spiral 
would be difficult or impossible to detect. Within the slice, however, the ML state is 
reduced to an equilibrium and the local spiral structure is clear, as shown in figure 8 (a). 
To project onto the two dimensions of the page, deviations from the ML state have been 
projected as in (2.8), against the real and imaginary components of its complex stability 
eigenvector, ei and e2 respectively, 

aj(t) = (a(t) -aMLJei) . (5.1) 

Once trajectories escape the neighbourhood of ML they are attracted to another state 
space region where the UB solution is to be found. Applying the same projection to all 
N2 travelling waves, figure 8 (&) shows trajectories along their most unstable directions. 
Shooting in opposite directions along the most unstable, 1-dimensional manifold of the 
MU state, one direction goes directly towards the UB state, the other spirals around 
the ML state first. All trajectories within the (5,^2) symmetry subspace are attracted 
towards a region close to the UB state, where the dynamics is mildly chaotic. In this 
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Figure 7. Travelling waves for the cell (2.4), reduced to equilibria by the method of slices. 
Colour map of stream-wise velocity relative to the laminar flow, lighter (darker) indicating posi- 
tive (negative) w in the range [—0.6, 0.7]. The N2 states (LB, ML, MU and UB) have symmetries 
{S,Z2), where the symmetry C2,e is implied. The S2 states originate from a symmetry-break- 
ing bifurcation off the N2 branch and have symmetries 5* and C2,e only. Shown is one fixed 
pipe section for each of the solutions. As the choice of the stream- wise position of such sec- 
tion is arbitrary, only meaningful comparison of different solutions is by their distance in the 
symmetry-reduced state space. 





-0.06 -0.04 
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(a) n, (b) 

Figure 8. (a) Projection of the dynamics local to the ML travelling wave which has been 
reduced to the equilibrium at (0,0) within the slice. The local spiral of unstable trajectories 
is now clearly revealed, the ML state having only a single complex unstable eigenvalue within 
its {S, Z2) symmetry subspace. (b) All N2 equilibria, perturbations restricted to the (S, Z2) 
symmetry subspace. The inset shows an expanded view near the UB state. The dark blue loop 
is a tiny relative periodic orbit with period T= 4.934. Axes as in (5.1). 



region we have found a weakly unstable tiny relative periodic orbit of period T — 4.934, 
shown in the inset to figure 8(6), that appears to dominate the long-time dynamics 
within the {S, Z2)-invariant subspace. Shooting in opposite directions from the LB state, 
trajectories proceed directly to either the upper region or the laminar state, suggesting 
that LB travelling wave lies within the laminar-turbulent boundary or 'edge'. 

Without restriction of dynamics to the (S*, Z2) -invariant subspace, trajectories stray 
much further from ML and show turbulent behavior. In order to track such trajectories all 
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Figure 9. (a) Removal of the Z2 symmetry of figure 8 opens the system to far more chaotic, 
or 'turbulent', transients (grey) within the 5* symmetry solution space that appear to frequently 
visit the travelling wave S2U, while the travelling wave S2L appears embedded into the laminar- 
turbulent boundary. The turbulent trajectory exhibits excursions to other states as well, most 
frequently ML and LB. (b) Two relative periodic orbits embedded within turbulence, the same 
symmetry-reduced state space projection as figure 8. Crosses are spaced every At — 2D/U on 
relative periodic orbit RPOio.96 and pluses are spaced 4 D/U on relative periodic orbit RP036.72. 
On this scale the tiny RPO4.934 [figure 8 (6), inset] only explores a region about the size of the 
plot dots, and plays no role in turbulent dynamics. 

travelling waves states listed in table 1 were deployed as templates, a'^^\ j = 1,2,- ■ ■ ,6, 
whereas the single template point a' = aML(O) sufficed for the symmetry reductions 
within the {S, Z2) subspace. Switching from one local slice to the next nearest one keeps 
the phase velocity (3.5) finite (see figure 66) and enables tracking of turbulent trajectories 
in the reduced state space. 

A typical trajectory is shown in figure 9(a). Within the (S',Z2)-invariant subspace 
trajectories hover near the UB state; but when Z2 symmetry is relaxed, and only S 
symmetry is enforced, the trajectories explore a far greater region of state space, and 
appear to be representative of turbulence in the full state space. The neighbourhood of 
the S2U state is visited frequently, and excursions to other states are occasionally seen. 
Interestingly, an excursion is observed towards the LB state. Its attracting manifold 
therefore appears to penetrate into the turbulent region, and, as it lies on the laminar 
turbulent boundary, attraction towards this manifold may be responsible for the observed 
sudden relaminarisation events. 



5.2. Relative periodic orbits in pipe flow 

Without symmetry reduction, the detection of a recurrence, i.e. that current state is 
close in structure to an earlier state on the same trajectory, requires calculating the 
minimum distance between their group orbits, i.e., minimum over all possible shifts. 
Within the symmetry-reduced state space the determination of recurrences is simple — 
by construction, a slice is the set of all nearby group orbit states closest to a given 
template, with symmetry shifts quotiented out, hence all group orbits are reduced to 
points, and all relative periodic orbits to periodic orbits. The shifts £p are determined 
by the slice condition (4.2). Figure 10 shows a recurrence plot used to detect the signal 
of a turbulent trajectory that shadows a nearby relative periodic orbit. The indicated 
minimum at At w 11 and its repeats are seen for a while as the relative periodic orbit 
RPOio.96 is shadowed for a rather long time. States from this minimum, along with the 
relative stream-wise shift for the candidate trajectory, i{t) — £(t — At) , were passed to our 
Newton-Krylov code. This led to the discovery of the relative periodic orbit that we label 
RPOio.96, and another recurrence plot led to the relative periodic orbit RPO36.72, both 
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Table 1. All travelling waves and relative periodic orbits studied in this paper for pipe (2.4), 
split by solution symmetry: (mean) kinetic energy E; (mean) dissipation D, both in laminar 
solution units; travelling wave downstream phase velocity c or relative periodic orbit mean phase 
velocity Cp = £p/Tp; accumulated relative periodic orbit shift £p (not modulo the periodic cell 



period Tp; the number of unstable eigen-directions within the solution's 

(j) 4-,-,,,(j) 



length L = 5.0265. 

symmetry subspace, r = real, c = complex; the leading Floquet exponent A"' = /i'--'' ±iuj'--" . For 

the upper part of the table, numbers in S rows are for symmetry-breaking eigenvalues when Z2 

is removed. 'Ergodic' refers to long time average computed from evolution of typical turbulent 

states. 



plotted in figure 9{b). (In absence of a systematic symbolic dynamics, we label RPOt 
by its period T.) 

Several two-dimensional projections of relative periodic orbits RPO36.72, RPOio.gg 
and the tiny RPO4.934 are given in figure 11, along with the N2 and S2 states used in 
this paper (same colour coding as previous plots). Figure 12 (see movie online) shows 
flow snapshots of RPO36.72 at a fixed axial cross-section. The movie has been taken after 
reducing the continuous symmetry with the method of the slices and hence shows how the 
orbit closes after one period. The orbit consists of a slow nearly quiescent phase, during 
which the neighbourhood of S2U is visited, followed by a period of intense turbulent 
bursting. This behaviour suggests that the orbit RPO36.72 may be related to a global 
homoclinic bifurcation off S2U. 



5.3. Discussion 

Symmetry reduction by the method of slices in a high-dimensional flow thus reveals 
dynamics around recently discovered travelling waves, both local and global, and leads to 
the discovery of first relative periodic orbits in pipe flow that, as they have been extracted 
from turbulent trajectories, can be expected to be dynamically important. While the 
tiny relative periodic orbit RPO4.934 appears to originate from a Hopf bifurcation off a 
travelling wave very nearby (Duguet et al. 2008; Mcllibovsky &: Eckhardt 201 1&, have 
also found similar local relative periodic orbits) RPOio.ge and RPO36.72 exhibit temporal 
variation typical of the turbulence found in our computational domain (2.4). 
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Figure 10. Search for recurrences within the shce. Each state is compared with the state at 
earher times At before, shading indicates the relative distance \\a{t) — a{t — Af)||c/||a(i — ^i)||c- 
The minima indicated by the horizonal lines suggest that an orbit of period T ~ 11 is shadowed 
for i < 40 (all times are expressed in units of D/U). Newton search indeed confirms this, by 
finding there the weakly unstable RPOio.ge- Note that the tiny relative periodic orbit RPO4.934 
from figure 11 (a) lies far from the turbulent region, and thus does not show up in recurrence 
plots. 
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Figure 11. Rate of the energy input at the walls / versus (a) the dissipation rate D, and (b) 
the energy E, see (2.7). Plotted are all invariant solutions of table 1, together with a typical 
turbulent orbit. The tiny RPO4.934 is visible as a little twiddle just below UB travelling wave. On 
the scale of these plots, the Duguct ei al. (2008) relative periodic orbit would be indistinguishable 
from its mother travelling wave. 



Visualisations of physical quantities, such as in figure 11, are often used in the literature 
to infer the importance of coherent solutions (e.g. travelling waves and relative periodic 
orbits in pipe flow) in turbulent flow. Here the dissipation D and input / of figure 11(a), 
for example, clearly show that states S2L, LB and UB are far from the turbulent flow. 
However, the converse is usually not true. As the energy balance (2.7) forces all travelling 
waves and the averages over all relative periodic orbits, and turbulent flow, to lie on the 
diagonal I = D, travelling waves that feature frictions close to the turbulent average 
may appear to be in core of the turbulent region. For example, figure 11 suggests that 
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Figure 12. Four snapshots of relative periodic orbit RPO36.72 at the same fixed pipe section 
as in (7), reduced by the method of slices into a periodic orbit solution (see movie online). A 
colormap of stream-wise velocity is shown, with white (black) indicating positive w — 0.6 U 
(negative w — —0.7U) velocity with respect to laminar flow. The f = state has been chosen 
to be the closest passage (in the energy norm) to travelling wave S2U, see (7). 

the ML and MU states may be representative of the turbulent dynamics. The projection 
within the slice (see figure 9) reveals that in fact these two states, despite having the 
'right friction', are far from the turbulent dynamics in phase space. Our resuhs show that 
the neighbourhoods of known travelling waves (table 1), with the exception of S2U, are 
visited only for a small fraction of time, in agreement with earlier estimates (Kerswell & 
Tutty 2007; Schneider et al. 2007; Willis & Kerswell 2008). It is only the reduced state 
space projections that make it quite clear that only RPOio.ge, R.PO36.72 and S2U are 
embedded in the region associated with turbulence. To sum up, phase-portraits using 
physically motivated quantities such as dissipation, input and kinetic energy, may be 
used to rule out the relevance of coherent states in turbulent flow but not to confirm 
their relevance. 

Another important point is that determination of travelling waves by bifurcations and 
continuation is often physically misleading. Almost all of the previously found travelling 
waves and nearby tiny relative periodic orbits are highly unstable to perturbations out 
of their symmetry subspace, highly repelling and not participants in the asymptotic 
dynamics (see table 1). The exception to this are the nearly laminar lower-branch states, 
which play a key role organising the dynamics of the turbulent-laminar boundary or edge. 
Instead, recurrences in turbulent flow used as initial guesses for Newton-Krylov methods 
allow it to find solutions that are relevant to the turbulent dynamics. Note that the 
new relative periodic orbits revealed here are associated to the lower dissipation region 
of turbulent flow; but is expected that application of the method slices together with a 
systematic study of recurrences in the upper region will yield new 'turbulent' relative 
periodic orbits and travelling waves. 

Finally, it is worth emphasising that restriction of dynamics to flow-invariant subspaces 
can potentially be very misleading. For example, figure 8 and 9 exhibit completely dif- 
ferent dynamics. In this case, imposing the rot ate- and- reflect symmetry, in addition to 
shift-and-reflect, results even in the absence of turbulent dynamics. Hence, despite the 
similarity of the dynamics of full-space and shift-and-reflect turbulence, our choice may 
also be problematic. 



6. Conclusion and perspectives 

As a turbulent flow evolves, every so often we catch a glimpse of a familiar structure. 
For any finite spatial resolution, the flow stays for a flnite time in the neighbourhood of a 
coherent structure belonging to an alphabet of admissible fluid states, represented here by 
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a set of travelling wave and relative periodic orbit solutions of Navier-Stokes. These are 
not the 'modes' of the fluid; they do not provide a decomposition of the flow into a sum 
of components at different wavelengths, or a basis for low-dimensional modelling. Each 
such solution spans the whole range of physical scales of the turbulent fluid, from the 
outer wall-to-wall scale, down to the viscous dissipation scale. Numerical computations 
require sufficient resolution to cover all of these scales, so no global dimension reduction 
is likely. The role of invariant solutions of Navier-Stokes is, instead, to partition the cx)- 
dimensional state space into a finite set of neighbourhoods visited by a typical long-time 
turbulent fluid state. 

Motivated by the recent observations of recurrent coherent structures in experimental 
and numerical turbulent flows, we initiated here an exploration of the hierarchy of travel- 
ling waves and relative periodic orbits of fully-resolved transitionally turbulent pipe flow 
in order to describe its spatio-temporally chaotic dynamics. For pipe flow travelling waves 
and relative periodic orbits embody a vision of turbulence as a repertoire of recurrent 
spatio-temporal coherent structures explored by turbulent dynamics. The new relative 
periodic orbits that we present here are a part of the backbone of this repertoire. Given a 
set of invariant solutions, the next step is to understand how the dynamics interconnects 
the neighbourhoods of the invariant solutions discovered so far. Currently, a taxonomy 
of these myriad states eludes us, but emboldened by successes in applying periodic orbit 
theory to the simpler Kuramoto-Sivashinsky problem (Christiansen et al. 1997; Lan & 
Cvitanovic 2008; Cvitanovic et al. 2009), we are optimistic. 

The reader might rightfully wonder what the short pipe periodic cells studied here and 
in plane Couette flow have to do with physical, wall-bounded shear flows in general, with 
large aspect ratios and physical boundary conditions? The 3-D fluid states captured by 
the short pipe invariant solutions and their unstable manifolds are strikingly similar to 
states observed both in experiments and in numerical simulations of longer pipes (Hof 
et al. 2004), while the turbulent dynamics visualised in state space appears to be pieced 
together from close visitations to coherent structures connected by transient interludes. 
Nevertheless, one of the outstanding issues that must be addressed in future work is the 
small-aspect cell periodicities imposed for computational efficiency. In case of the pipe 
flow, most computations of invariant solutions have focused on stream-wise periodic cells 
barely long enough to allow for sustained turbulence. Such small cells introduce dynamical 
artifacts such as lack of structural stability and stream-wise cell-size dependence of the 
sustained turbulence states. Here we can draw inspiration from pattern-formation theory, 
where the most unstable wavelengths from a continuum of unstable solutions set the scales 
observed in simulations, with recent progress reported both from the 'microscopic scales' 
(Schneider et al. 2010), as well as long pipe experiments and phenomenology (Avila et al. 
2011). 

The main message of this paper is that if a problem has a continuous symmetry, 
the symmetry must be used to simplify it. Ignore it at your own peril, as has been 
done earlier in Kuramoto-Sivashinsky (Christiansen et al. 1997) and plane Couette flow 
(Gibson et al. 2008); the invariant solutions found by restricting searches to the discrete- 
symmetry invariant subspaces have little if anything to do with the full state space 
explored by turbulence, no more than the equilibrium points of the Lorenz flow have 
to do with its strange attractor. Note also that the shift of a pipe flow into a slice is 
not a stream- wise average over the 3D pipe flow. It is the full flow snapshot, embedded 
in the (X)-dimensional state space. Symmetry reduction is not a dimensional-reduction 
scheme, or flow modelling by fewer degrees of freedom: the reduced state space is also 
oo-dimensional and no information is lost, one can go freely between solutions in the full 
and reduced state spaces by integrating the associated reconstruction equations. 
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Symmetry reduction by method of slices is numerically efficient. Coupled with our state 
space visualisations, it allows for explorations of high-dimensional flows that were hitherto 
unthinkable. Symmetry reduction is here achieved, and now all pipe flow solutions can be 
plotted together, as one happy family: all points equivalent by symmetries are represented 
by a single point, families of solutions are mapped to a single solution, travelling waves 
become equilibria, and relative periodic orbits become periodic orbits. Without symmetry 
reduction, no full understanding of pipe and plane plane Couette flows is possible. 
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Appendix A. Discrete symmetries 

In addition to azimuthal reflection, invariant solutions can exhibit further discrete sym- 
metries that derive from azimuthal and stream- wise periodicities over the computational 
ceU (2.3). 

Periodicity in the azimuthal direction allows for solutions with discrete cyclic symmetry 
g{2'!T/m, 0), defined for integer m. Velocity fields invariant under such rational azimuthal 
shifts are said to be invariant under the discrete cyclic group Cm^e- Note that all solutions 
are invariant under Ci.g, and given the assumed stream-wise periodicity, under Ci.z as 
well. This permits the study of states in the reduced computational cells fl = [0, 1/2] x 
[0, 27r/TO] X [0, 7r/a], where L = n/a. Calculations in larger domains are required to 
determine subharmonic bifurcations. 

Consider states invariant under Gm,e and Ci^z, and denote half-shifts within our re- 
duced cell, in and z respectively, by gg = g{-K/m, 0) and g^ = 5(0, L/2). For the special 
case of a half-shift in azimuth, a and gg commute so that 

G = DixC™,exCi,, cr (Al) 

is abelian and of order 8, 

G = {e,ge,gz,9egz,(7,<yge,(jgz,ag0gz}. (A 2) 

Focus lies on the following subgroups: 

Z = {e,a}, 5 = {e,cr5z}, ^^ ={e,gegz}. (A3) 

The first is the 'reflectional', or 'mirror' symmetry, the second is the 'shift-and-reflect' 
symmetry, and the third is the 'shift-and-rotate' symmetry. States invariant under gg or g^ 
are invariant under C2m,0 or C2,z and hence become redundant upon redefinition m := 2m 
or a := 2a (i.e. they reduce to half-cells). It can also be shown that agg = gg ogj , 

^ /2 . . 1/2 1 /2 

where gg is the half-half-shift, and therefore that crgggz — gg crgz gg ■ Invariance 
under these combinations is conjugate to Z and S. We use, however, the 'rotate-and- 
reflect' subgroup, denoted by 

Z^^{e,age}. (A 4) 
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which has mhror reflection planes located at 6* = ztTT/{2m) (see figure 7 for the case 
m = 2). 

The first travelling waves found for pipe flow were invariant under S and Gm,9 for 
m = 2,3,4,... (Faisst k Eckliardt 2003; Wedin & Kerswcll 2004). More recently the 
'missing' to = 1 state has been located (Pringle & Kerswcll 2007) and many more states 
invariant under more than one of the above classes (Pringle et al. 2009). States invariant 
under {S,Z) implies invariance under aag^ = gz^ and hence under Q2,z, reducing to 
the half-length pipe. Invariance under (5, r2„j) is permissible, however, and using the 
combinations above it can be calculated that {S, ^m) = {S, Zm) — {Zm, ^m)- Such states 
have been termed 'highly symmetric' by Pringle et al. (2009). As reflection is arguably 
easier to visualise than shift-and-rotate, we use the notation {S, Zm) for these states. 
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